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■ Crick and Milcnlson have presented a hypothesis for the font- 

■ tioasl r«l* of dream sleep ln»»l**eg u 'uulcurnlttc 1 proms. 
We have independently canted ant nuthematlcal aad eompnter 
ntodellmg of learning and 'aatorntag' to a ce&ctfve neural 

"network of 30-1,000 ■cauwo**. The model network has a 
:,oiBt^^ddrcsMsfe memory or 'assodfitrve ncnory' which 

\^P»jin It to JcUn Utd atone maoy memOma. A. paxttadar 

\to>jnMrjrcan be evoked Am iti entirety when «ae network It 
dfatokled ey any tdeotllte-dzed subpart of the infomalion 
oWtemory 1 , Beit different memories of the nne site are 

x^oi^i^^i^m KaSL Ma^ when memories are learned, 
mhmvritt are alio created and can alio be evoked. 
Applying m 'tmlearniag' process, similar to the karnfiig pro- 



.enhances 'ihe peeformaBce of the Network In aecesffng reaJ 
venortei'aad to nfaimfcdnE spariotn ones. Although our model 
prat not motivated by higher nervous functio*, our system 
dbplayi behayiotiri which are strikingly parallel to those seeded 
tor tut hypothesized role of *onlewrntng' in rapid eye movement 
(REM) deep. ,~ 

In the 'most symmetric form of collective memory in our 
dynamic neural network 3 , each neurone, j, has two states, and 
is described by a variable pj=±l. The instantaneous state of 
the system of /V neurones can be thought of as an rV-dimeosional 
vector hfiving components p t of size 1. The neurones are inter- 
connected by a network of synapsce, with a synaptic strength 

Tj, from neurone j to neurone i. The instantaneous input to 
neurone iis 

input to i = I Ty^i 
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No. or unlearning trials 
Fie. 1 The fraction ot random iiBrnog rota which teem ta 
particle metnoriet (saxsribility). The five dashed lines ire the five 
uomiual lutntoiici. TIk wliU line b the total soceulbtllty of a]] 
spurious memories. Ic these trials e was set at 0,01. 

where /ij is the present state (±1) of neurone j. The neural 
state of the system changes in time under the following 

algorithm. Each neurone i interrogates itself at random Ul time, 
but at a mean rate W, and readjusts its state, setting Mi™ ±1 
.according to whether the input to i at that moment is greater 

.. or less than aero. The neurones act asynchronously. 

This algorithm defines the time evolution of the state of the 

- system. For any Symmetric connection matrix, there are stable 
states of the network of neurones, in which each neurone is 
either 'on' and has aa input »0 or 'off* and has aa input <0. 
These stable states will not change in rime. Starting from any 
arbitrary initial state, the system reaches a stable state and 
ceases to evolve in a time of -3/ W. 

The stable states of the system can be arbitrarily assigned by 
an appropriate eboics of T lt . Suppose « different AT dimensional 

state vectors ■ ■■ .. .•>,:.>:■„• 

MtlH.a-ltoi«0.2SAr-' '■' \' V ;;1 ? 
are to be stable states oi the system. If these state vectors are 

Sufficiently different, and if tha "synaptic, conneotum irj^tTW-T'iJ '- 
is given by -rw:-'2> v '-< 

ru-XufMi; r,-o "V'' 1 ',, 

islj • 

then the states it' will be stable slates of the system. ] ' '. . 

This network now functions as an associative memory! If 
started from ait initial state wlikh resembles somewhat eutc 
a' and which resembles other,/u,*{s / 1) very little, the state win 
evolve to the state /i\ The states m' are avnVahle memories, 
and the system correctly reconstructs an entire memory from 
any initial partial information, as long as the partial information 
was sufficient to identity a single memory. Detailed properties 
of the collective operation of this network have been 

described previously 1 , "" 

The form of the T ti matrix can be described as an incremental 
learning rule. To learn a new memory increment T„ by 

learn jt~" Ar« = m?"Vj ™ 
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- system ii state ^T^br exampjc^^o by external inputs— 
and enabling a learnine process thaMPjws all T u to increment. 
The information needed by each synapse is local— the incre- 
ment for synapse ij does not depend on the global structure of 
the new slate or past memories, but only on ^i™" and ^J"~. 

Under this algorithm, when random starting states are 
uboscn, some stored memories arc mush more accessible than 
others, that is, considerably larger numbers of randomly chosen 
initial stales lead to some memories than to others. This is a 
vagary of the particular set of memories which have been 
learned. It occurred to us that it would be possible to reduce 
this unevenness ot access (which can be intuitively described 
as the "50% of all stimuli remind me of sex" problem) by 

'unlearning'. 

Specific unlearning was implemented by choosing starting 
states at random; when a final equilibrium state n' was reached 
H was weakly ub learned by the incremental change 

unlearn ji f Arij«--cMU|.0<e* 1 

Figure t illustrates the effect of unlearning on the accessibility 
of five stared memories in a set of 32 neurones. Accessibility 
is quantitatively defined as the fraction of random initial stales 
leading to a particular final stable state or group of states. The 
unevenness of the lines is due in part to statistical noise in the 
simulation. The accessibility of th» nominal auigncd memoHe* 
initially ranges overa factor of 3, but converges with unlearning 
to a spread of only a factor of 1.4. Thus the accessibility is 
much more uniform (or in Crick-Mitchi$on terms, the relative 
stability of the modes made more uniform) after specific 
unlearning, and the system will have functionally impmveU 
recall. 

In our modal Utt storage of a set of assigned memories in 
T u also produces a set of Spurious stable slates which were not 
inserted as memory states. One of the strong effects of unre- 
membering h to reduce the total aceessibilUy of spurious states, 
as shown by the solid line in Fig. 1. 

The qualitative reason for the success ul unlearning vomes 
from the behaviour of the 'energy' £, defined for any state /i as 



The change ol neural s 



b according to the asyn- 



chronous algorithm monotonicany decreases £ until a final 
stable' state is reached— either a stored memory or a spurious 
memory. Any stable state <i" has. for a given 7* an energy 
B". There is a strong tendency for the states having the deepest 
energy valleys to collect from the largest number ot random 
starting states, that h> deep valleys are also broad. When a final 
state y." is unlearned, its energy £' is specifically raised and Its 
valley -of collection diminished relative to other states. Whik 
thfe argnmfcnt indicates why accessibility of stored memories 
VSho'uId be made more nearly even by unlearning; only a detailed 
■ ^habits shows why the spurious states should be so sensitive 
" ; toiL Jdo much unlearning will ultimately destroy the stored 



■ the .exempl^ j^^i* 

Memory 1 ' ~^WK&^iiiM^0i!vs? 
Memory 2 Walter. Mack ,; 

Memory 3 Harold, grey " . \. . y«: 

Spurious memory Walter, grey 

where grey is taken as a category equally resembling black and 
white. This spurious state ts more stable when 'Harold' and 
'Walter' have a significant correlation— perhaps 'Harold' and 
'Harry' These particular cpmiou* rtatei are not limply transi- 
tive logical associations of the form A«+B, B**C; -*A**C. 
They are truly spurious 'illogical' associations, but perhaps 
'plausible 1 as they come (ram correlations in the structure of 
memories. 

In our simple system, unlearning improves memory foncikm 
both by the equalization of accessibility and the suppression of 
spurious memories. We aslced whether other simple algorithmic 
changes such as clipping the r u matrix or a threshold effect 
produce an equivalent improvement m memory performance. 
These two do not, presumably because they tacit the essential 
element of the present scheme, that is, the feedback via the 
algorithm of information about the accessibility of particular 
states. We believe the results found will be insensitive to 
whether the state component values are taken as 0 and II or ±1. 

The REM sleep hypothesis of Crick and Mitehison 1 refers 
to higher level processing. Our example illustrates that from a 
mathematical viewpoint the general idea could work as they 
described. K the Crick-Mi tchison hypothesis is correct, one 
might ask about correlations between the structure of the 

spurious linkages in modelling and the strange associations 
present in dreams. 

We thank F. Crick and D. Willsnaw for discussions. This 
work was supported in part by NSF grant DMR-81Q7494 and 
by me System Development Foundation. 
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We have identified a class uf »puiiuu« «latt*, which in their 
most elementary form have their origin in triples. As an example 
on 16 neurones 

■■'•Memory! + + +■+— =;^* + - + - + - - 

Memory 2 + < ' ' + _ + + 

Memory^ + + — + + --|+-- + 4~- + 
Spiirious memory + + + + 1 + + + + 

The stability of the spurious memory is enhanced if the first 
halt of cucoiory 3 » Weekly correlated with memories 1 and 2. 
Mathematical analysis of the statistical stability of such spurious 
states "shows that they are typically less stable than the assigned 
memories, and that the stability will also depend on correlations 
with other memories. The nature of these spurious states can 
be described by analogy in Lwius of higher level function by 



lnfuta esquire whatever language k 

mMtf »to whit* th«y tfl bm. Tha'ni . 

newborn slsUd is not Uased to any way towmrds tfa* eopttttloii 
of one In 



i of th e 

ntho th** a the properties oJ btiviAtri tas^ifet, 
which they ia corporate in tbetr models are preswawi tto 



cotsssnlwnMM are prestwaed to Deehar»xiHt^c4tb*hw*M» 
bMguage precessteg system, rather van, say, she French, 



Eogfit*, c* Igbo h 

however, on a comprehesmon atrattfy w» 
■ted by tative speakers rS Pr«eh bat not by wathe speakers 
of Eagtsaw ■ ■ 

Underlying our finding is ajtractural difference between the 
two languages: trench and English differ conslderawy tn the 
degreerto which syllable boundaries are clear and unambiguous. 
In French, syllabic structure is relatively easily determined.; 



